Speaking to the Crowd: Looking at Past Achievements in Using Crowdsourcing for Speech and Predicting Future Challenges
نویسندگان
چکیده
This paper examines the literature on the use of crowdsourcing for speech-related tasks: speech acquisition, transcription and annotation as well as the assessment of speech technology. 29 papers were found, representing, 37 different experiments, which were annotated and analyzed to find trends in the field. The paper focuses on the different techniques used for quality control and the variety of sources of “crowds”. Finally, we propose several challenges for the future of crowdsourcing for speech processing.
منابع مشابه
Perform Three Data Mining Tasks with Crowdsourcing Process
For data mining studies, because of the complexity of doing feature selection process in tasks by hand, we need to send some of labeling to the workers with crowdsourcing activities. The process of outsourcing data mining tasks to users is often handled by software systems without enough knowledge of the age or geography of the users' residence. Uncertainty about the performance of virtual user...
متن کاملMotivational feedback in crowdsourcing: a case study in speech transcription
A widely used strategy in human and machine performance enhancement is achieved through feedback. In this paper we investigate the effect of live motivational feedback on motivating crowds and improving the performance of the crowdsourcing computational model. The provided feedback allows workers to react in real-time and review past actions (e.g. word deletions); thus, to improve their perform...
متن کاملAssessing the Iranian Fiscal Sustainability in Past and Future through Tax Side of the Economy
This paper, I have focused on the tax side of the fiscal policy to investigate the past and future behavior of fiscal sustainability in Iran. To do so, I have employed two different forward-looking and backward-looking approaches. First, the backward-looking approach is the fiscal policy rule proposed by Daving & Leeper (2011). Precisely, this rule determines that whether the fiscal policy is ...
متن کاملAnalysing the Stewardship Function in Botswana’s Health System: Reflecting on the Past, Looking to the Future
Background In many parts of the world, ongoing deficiencies in health systems compromise the delivery of health interventions. The World Health Organization (WHO) identified four functions that health systems need to perform to achieve their goals: Efforts to strengthen health systems focus on the way these functions are carried out. While a number of studies on health systems functions have be...
متن کاملA Methodology for Corpus Annotation through Crowdsourcing
In contrast to expert-based annotation, for which elaborate methodologies ensure high quality output, currently no systematic guidelines exist for crowdsourcing annotated corpora, despite the increasing popularity of this approach. To address this gap, we define a crowd-based annotation methodology, compare it against the OntoNotes methodology for expert-based annotation, and identify future ch...
متن کامل